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Abstract. - We introduce the concept of information compressibility, Kj, which measures the 
relative change of number of available microstates of an open system in response to an energy 
variation. We then prove that at the time in which the system reaches a steady state, the second 
and third time derivatives of the information entropy are proportional to the corresponding time 
derivatives of the energy, the proportionality constant being Ki. We argue that if two steady 
states with different but same-sign Ki are dynamically connected in a non-adiabatic way it takes 
a longer time to reach the state with compressibility closer to zero than the reverse. We also 
show analytically that for a two-level system in contact with external baths, the information 
compressibility is inversely proportional to the temperature measured at any given time by a probe 
that is coupled to the system, and whose temperature is adjusted so that the system dynamics 
is minimally perturbed. This concept, that applies to both classical and quantum open systems, 
thus provides insight into the properties of non-equilibrium steady states. 
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Introduction. — Dynamical systems are to some ex- 
tent always in interaction with one or more external envi- 
ronments. The latter ones may exchange particles and/or 
energy with the system of interest. Under certain condi- 
tions this leads to a non-equilibrium steady state (NESS) 
of the system dynamics. This situation arises in vari- 
ous physical systems, from chemical and biological pro- 
cesses [1] to nanoscale systems [2]. The properties of 
NESSs, whether quantum or classical, have long been the 
subject of numerous studies but a comprehensive theoret- 
ical description is still lacking, especially for NESSs far 
from equilibrium [3]. One aspect, in particular, that has 
received much less attention is the approach to steady 
state, [4] and the entropy variation in such instance. 

The difficulty in describing properties of NESSs and 
the approach to steady state can be in part attributed 
to the lack of a general physical quantity that character- 
izes such states, especially far from thermodynamic equi- 
librium. Such a quantity needs to take into account the 
microscopic dynamics of the system and, at the same time, 
provide a global physical description that is, in principle, 
easy to access theoretically and/or experimentally. 

In this Letter we introduce such a quantity that we name 
information compressibility, Kj. The latter measures the 
"easiness," or "difficulty," to vary the relative number of 



available microstates of an open system when its energy 
changes due to the interaction with the environment (s). 
This concept is the information counterpart of the simi- 
lar concept for solids, liquids or gases, where the standard 
compressibility quantifies the relative change of the vol- 
ume with respect to a pressure variation. 

The advantage of the information compressibility in 
characterizing non-equilibrium systems stems from the 
fact that it allows us to establish several results regard- 
ing the approach to steady state. We prove analytically 
that at the time in which the system reaches a steady state 
the second and third time derivatives of the information 
entropy are proportional to the corresponding time deriva- 
tives of the energy. In both cases, the proportionality 
constant is Kj at that instant of time. The entropy pro- 
duction at that moment can be thus minimal or maximal 
according to the sign of the information compressibility 
and the concavity or convexity of the energy function. In 
addition, we can argue about the time it takes the system 
to reach a steady state with a given information compress- 
ibility from another steady state with different Ki, when 
the two are connected non-adiabatically. We find that 
when the two compressibilities have the same sign it takes 
a longer time to reach the state with compressibility closer 
to zero than the reverse process. The reason for this be- 
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havior can be intuitively attributed to the fact that the 
fluctuations induced by the presence of the environment 
act against the first process, while they "help" the second 
one. No such conclusion can be reached if the two states 
have compressibilities of different sign. We will illustrate 
these findings with a model of a two-level system in contact 
with two thermal baths. In this case, we can also show an- 
alytically another interesting result: the information com- 
pressibility is inversely proportional to the temperature 
measured at any given time by a probe that is coupled to 
the system, and whose temperature is adjusted so that the 
system dynamics is minimally perturbed. While we can- 
not prove this statement in the general case, it shows that 
this concept, which applies to both quantum and classical 
open systems, provides a lot of insight into the properties 
of non-equilibrium steady states. 

Definition of information compressibility. By 

varying the energy of an open system the number of mi- 
crostates (in the appropriate phase space) available to it 
generally changes. This means that there is a loss - or 
gain - of information when the system interacts with the 
environment (s). By energy and entropy we mean the fol- 
lowing. 

Consider the many-body Hamiltonian 



compressibility as 



H to t = Hs + H B + Hi nt , 



(1) 



where Hs is the Hamiltonian of the system we are inter- 
ested in, Hb is the Hamiltonian of the bath(s) degrees of 
freedom, and H int describes their mutual interaction. The 
above Hamiltonians may describe either a quantum or a 
classical system. To be specific, from now on we refer to 
the quantum case only, but all considerations we make ap- 
ply also to the classical case, with the appropriate change 
of quantities (e.g., the replacement of the density matrix 
p with the classical phase density). 

Call ptot the density matrix associated with the total 
Hamiltonian. We may then define the reduced density 
matrix p of the system alone by tracing out the degrees of 
freedom of the bath(s), namely 



p = Tr B {/3 tot }. 



(2) 



Note that, in general, there is no closed equation of motion 
for p. At this stage, this is of no concern to us and we 
assume that we know this operator at any given time. We 
can then define the average energy of the system as 



E(t) = Tv{p(t)H s }, 
and the information entropy 

S(t) = -k B Tr{p(t)ln P {t)}, 



(3) 



(4) 



with ks the Boltzmann's constant. 

Call £1 the number of microstates available to the sys- 
tem at any given time. In analogy with the standard com- 
pressibility of matter we can thus define the information 
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E(t) 



namely the relative variation of the number of microstates 
with respect to an energy variation, evaluated at the in- 
stantaneous energy. 

This definition, however, would require an explicit cal- 
culation of the number of available microstates. This is 
not always easy to do. We thus seek an alternative defi- 
nition that is computationally more convenient. We note 
first that in micro-canonical equilibrium the number of 
available microstates is related to the entropy S of the 
system via the relation £1 = cxp(S , /fcs). If we introduce 
such definition into Eq. (5) we get 



Kj(t) = 



k B SE 



(6) 



E(t) 



We could choose Eq. (6) as definition of information com- 
pressibility in the general case as well, with the infor- 
mation entropy given by Eq. (4). Note that despite 
its similarity with the well-known equilibrium quantity 
(3 = 1/fcsT, with T the temperature, Eq. (6) depends on 
time, and therefore it cannot be generally interpreted as an 
inverse thermal energy (except at canonical equilibrium, 
or for the two- level system example we give below). Fur- 
thermore, a simple functional dependence of the entropy 
on energy may not generally exist out of equilibrium and, 
if it docs, it may not be unique. In fact, since the entropy 
is a non- linear functional of the density matrix, while the 
energy is a linear one, Eq. (6) may even provide multi- 
ple values at specific times. Therefore, definition (6) is of 
limited use, except for specific cases. Instead, both the in- 
formation entropy and the energy are generally accessible 
at any given time, which implies that their time derivatives 
are known functions. We thus replace the definition (6) 
with the following - computationally more convenient 
form 

. . 1 dS dt' 

with S(t) and E{t) evaluated as in Eqs. (4) and (3), respec- 
tively. We stress that although Eqs. (5), (6), and (7) could 
all be equally used to define a measure of information com- 
pressibility, we will show in the subsequent discussion that 
the last one is a natural extension of the concept of inverse 
temperature out of equilibrium. Therefore, this is the def- 
inition of information compressibility we postulate from 
now on. 

Before discussing the open-system problem let us check 
the physical meaning of Eq. (7) for known cases. First 
of all, we realize that if the system is in a steady state 
the energy variation is zero, as well as the entropy varia- 
tion. The information compressibility would thus acquire 
a constant value, 1 which depends on the dynamics of the 



In some cases Kj may even diverge, indicating that energy re- 
laxes faster than the entropy. 
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system approaching the given steady state. In addition, 
the information compressibility (7) may be either positive 
or negative at any given time, with the negative sign in- 
dicating an increase (decrease) of entropy with decreasing 
(increasing) energy supplied to the system by the environ- 
ment (s). 

For a closed system the information entropy docs not 
vary in time, irrespective of the energy variation [5]. 
Therefore, as expected, the information compressibility for 
closed systems is zero at any given time: no matter how 
much the energy of a closed system varies, the number of 
available microstates is constant in time (property of the 
unitary evolution). 

Let us now consider a system in global canonical equi- 
librium with a bath at temperature T. In this case the en- 
tropy is S c = k B lnZ c + E eq /T, where E eq = Tr{p e jH s } 
is the average energy of the system at equilibrium, Zq 
is the canonical partition function, and the canoni- 
cal density matrix. By differentiating this entropy with 
respect to the energy (at fixed volume and number of par- 
ticles) we get Kf = l/k B T, which is the well-known quan- 
tity (3 of equilibrium statistical mechanics. [5] The infor- 
mation compressibility is thus a natural extension of (3 to 
the non-equilibrium case, where the concept of tempera- 
ture is less obvious. 

This result also shows that the higher the temperature 
the more difficult it is to change the relative volume of 
available microstates. In fact, a large temperature means 
a highly-disordered state, and it is thus natural to think 
that, for a given small energy variation, the relative change 
of entropy (or level of disorder) would be small by adding 
(or subtracting) more states. Conversely, a small temper- 
ature means more order in the system. A small change 
in energy thus produces a relatively larger change in the 
number of microstates available to the system. 

Approach to steady state. — To illustrate the use- 
fulness of the concept of information compressibility, let 
us now examine the role of Kj in the approach to steady 
state. If we differentiate Eq. (7) with respect to time we 
get 

, dKj dE d 2 S , „ d 2 E 

Let us now assume that the system reaches a steady state 
during time evolution. Call t ss the time at which this 
occurs. 2 At steady state dKj/dt = (as well as dE/dt = 
0) so that from Eq. (8) we get 

d 2 S 
dt 2 



k B K T 



d 2 E 



t=t: 



dt 2 



(9) 



where t — tj a means the limit in which the time approaches 
t ss from the past. We can differentiate once more Eq. (8), 
and at steady state we obtain the relation 



d 3 S 
dt 3 



k B Kj 



d 3 E 



dt 3 



(10) 



t=t: 



which is an even stronger property than Eq. (9). However, 
further differentiation of Eq. (8) does not provide a simple 
relation between the n-th time derivative of the entropy 
and the n-th time derivative of the energy, even at steady 
state. The reason is that time derivatives of Kj of or- 
der higher than one appear in such expression, and these 
derivatives are not necessarily zero at t ss ■ The above rela- 
tions also show that in the case of non-equilibrium steady- 
states, the entropy can be either maximal or minimal at 
the onset of steady state. This depends on both the con- 
cavity or convexity of the energy function at that time 
- i.e., whether the energy is supplied to or taken away 
from the system by the environment (s) - and the sign of 
the information compressibility These functions, in turn, 
depend on the dynamics (and initial conditions) of the 
system approaching the steady state, with the approach 
possibly being non-monotonous. Note also that the re- 
verse is not necessarily true: the validity of Eq. (9) is not 
sufficient to guarantee that the system is in a steady state. 

Having discussed the entropy variation at steady state, 
let us now apply the above concept to study the time it 
takes the system to go from a given steady state with infor- 
mation compressibility, to a steady state with differ- 
ent (but equal sign) compressibility, Kj , and the reverse 
process (see inset of Fig. 1). Let us call S\ and E\, the 
information entropy and energy of the first steady state, 
respectively, and S 2 and E 2 , the corresponding quantities 
of the second. 

We are concerned here with two different steady states 
which are connected non-adiabatically, and have the same- 
sign Kj. 3 For clarity, let us assume 



K<P>Kf\ 



(11) 



and both quantities are positive. Let us first consider the 
time t s V at which we increase the energy of the system 
(which implies that the entropy increases as well) so that 
the latter evolves from the steady state 1 to the steady 
state 2 (dKi/dt < at t s V)- Referring to Eq. (8), we then 
see that its lhs is a negative quantity. Since, by assump- 
tion, both d 2 S\/dt 2 and d 2 E 2 /dt 2 are positive at tiW we 
find that at that instant 

' 2 ^- ~>cPe, 



dt 2 



(12) 



namely the entropy variation is "slower" than the corre- 
sponding energy variation. If we repeat the same reason- 
ing for the time t s 2 J at which we reduce the energy (and 
entropy) to recover steady state 1 from steady state 2 (we 
are assuming here that all these times are finite), we find 
instead 



d 2 S 2 



dt 2 



> k B K) 



(2) 



d 2 E 2 



dt 2 



(13) 



J Note that this time may be infinite. 



3 "Non-adiabatic" means that the physical properties of the envi- 
ronment (e.g., its temperature) are changed faster than the dynamics 
of the system. An adiabatic path between the two steady states re- 
sults, by construction, in a time-symmetric evolution from one to 
the other, and vice versa. 
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namely the disorder varies faster than the corresponding 
energy variation. Note that these arguments depend only 
on the properties of the information compressibility close 
to the initial and final state, irrespective of the full dynam- 
ics. We thus argue that it takes longer to reach the steady 
state with compressibility closer to zero than the reverse 
process. The same can be concluded for two steady states 
with negative compressibilities. This reflects the intuitive 
notion that the fluctuations induced by the presence of 
the environment act against the "compression" of the vol- 
ume of available microstates, while they favor the reverse 
process. 

Note that one cannot say anything about these time 
scales when the compressibilities of the two steady states 
differ in sign. In such a case, applying the above argument 
leads to the obvious mathematical statement that a nega- 
tive number is smaller than a positive one, thus precluding 
any conclusion on the time scales of the two processes. 

Example. — We now illustrate the above results for 
a specific model system. We study a quantum two-level 
system in contact with two heat baths kept at two different 
temperatures. We work in the Markovian approximation 
and use the Lindblad equation (h = 1) [6,7], 

p = -i[H, p] + Cip + C 2 p 
A = -\{V?Vi,p} + V iP vl, i = l,2 (14) 



where p = 



is the density matrix, and 



Pu P12 

9*12 1 - PU 

the Hamiltonian and relaxation operators are given by [7] 



H 



Vi 



u 




1/2 



exp 



exp 



( 4k :bT, ) 



(15) 



Here Ti (i = 1, 2) is the temperature of the i-th bath, uj is 
the two-level energy separation, and 7, = 70 cosh ^ 2 tgT ) 
is a normalization factor with 70 some relaxation rate. 
This form is chosen such that detailed balance is satisfied 
for each thermal bath independently, and the relaxation 
rates remain finite even in the limit T — > 0. (One can, 
in fact, choose different normalizations for the Lindblad 
operators. Such a change does not affect qualitatively the 
results presented here.) 

The analytical solution of Eq. (14) for arbitrary times 
is too cumbersome to be presented here. We thus show 
only the main results. We have calculated the dynamics 
of the system, starting from some initial condition, with 
the initial parameters u> = 1 (which sets the energy scale), 
70 = 0.1 and T x = 2,T 2 = 0.2. We then let the system 
evolve into the steady state. At a time t S s we vary T2 non- 
adiabatically. We have varied T2 instantaneously both to 
a value T2 = 2 (blue solid curve in inset of Fig. 1) and to a 
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Fig. 1: (Color online) The information compressibility Ki, and 
the derivative ratios t-K^-I^tM- and -r-^S/^S as a function 

Kb dt z I dt z Kb dt- 1 I dt s 

of time (in units of 1/w) for the example given by Eqs. (14-15) 
(see text for parameters). As the system approaches the steady 
state, all three quantities converge into a single value. Inset: 
dynamics of the information compressibility. As discussed in 
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value T2 = 0.16 (red dashed curve in inset of Fig. 1). We 

again wait until the system reaches a new steady state. 
(2) 

This occurs at a time t y ss ' when we also switch T2 back to 

its initial value. The initial steady state is finally reached 

at a time t ss (see inset of Fig.l). 

In Fig. 1 we plot the information compressibility Kj 

and the derivative ratios j^-^f/^r and r~4t^/^ as a 

(2) 

function of time, for times less than t = t ss for the case 
in which T2 has been varied to T2 = 2. As predicted by 
Eqs. (9-10) we find that the derivative ratios converge to 
Kj as the system approaches the steady state. We obtain 
the same result (not shown) for the time t ss , when the 
system is driven back to the original steady state. 

In the inset of Fig. 1 we plot the time-dependence of 
Kj, to illustrate its dynamics for the two cases considered 



above. We indeed find that (4? - t ( S s>) > (t ( s V - t¥ s ') 
when > \KP\ (blue solid curve) and (ti? - iff) < 



(3) d2h 



(i£ } - t { st } ) when \Kj L >\ < \Kf'\ (red dashed curve), thus 
corroborating our analysis. 

Local temperature out of equilibrium. The 

concept of information compressibility also provides some 
insight regarding another interesting question. Consider a 
system, like the two-level system discussed previously, to 
which a thermometer is (weakly) coupled. In equilibrium, 
the thermometer would thus measure the temperature of 
the system. Now let the latter evolve. The system then 
ends up into a new state, which may or may not be an 
equilibrium state. Irrespective, during time evolution the 
system is out of equilibrium. If we assume that the relax- 



(2) 



p-4 



Information compressibility 



ation time of the thermometer is faster than the dynamics 
of the system, then the thermometer would probe a "tem- 
perature" that varies in time. The question is then, what 
is this time-dependent temperature that the thermometer 
is measuring? 

We cannot provide an answer to the general case but 
we can conjecture that under suitable conditions this tem- 
perature is precisely the non-equilibrium generalization of 
the equilibrium temperature, and is the inverse (in units of 
ks) of the information compressibility Kj. Let us deter- 
mine under which conditions this conjecture is correct for 
the simple two-level system example. In order to mimic a 
thermometer connected to the system, we couple the latter 
to an external probe (which may, e.g., represent the phys- 
ical tip of a scanning tunneling microscope-mounted ther- 
mometer [8]). Mathematically, this amounts to adding an 
additional relaxation operator to Eq. (14) of the form (15), 
with a temperature T pro bo and some coupling 7 pro bo. Now, 
Tprobo is allowed to "float", i.e., for any given instant of 
time t we vary it until the dynamics of the system is 
minimally perturbed (we call this a "floating temperature 
probe") [9]. This is equivalent to assuming that a local 
equilibrium has been established between the system and 
the probe at any given time, again assuming that the re- 
laxation time of the probe is much faster than the system 
dynamics. 

The function T pro b e (i) is such that there is no change 
of dynamics with or without the probe. Let the den- 
sity matrix p(t) be the solution of Eq. (14) without the 
additional probe operator. Then, in order for the solu- 
tion not to change in the presence of the additional probe, 
the condition £ pr obepprobe(i)]p(i) = must be satisfied. 
In general, this condition does not hold unless the off- 
diagonal elements of the density matrix are zero at any 
given time. This amounts to saying that the environments 
induce decoherence on time scales much faster than the 
time scale over which the system evolves. Then, using the 
definition of the relaxation operators in Eq. (15), it is a 
matter of algebra to find that the diagonal elements of 
[T probe (t)]p(i) vanish if 



fc.B tprobo (t) = U) 



log 



Pu(t) 



(16) 



irrespective of the coupling 7 pro bc- 

We now calculate the information compressibility. In 
this simple example we have E(t) = u>pi\(t) and 
S(t)/k B = -p n (t) Iogpn(t) - (1 - pu{t)) log(l - p u (t)). 
Thus, one can explicitly extract S(E(t)) and we have 



~k~B ~SE 



1 



E(t) 



■log 



Pu(t) 



(17) 



and hence Ki(t) = l/fcsTp ro be(i), as conjectured. We 
note again that we cannot give a similar analytic proof for 
the general case. However, numerical verifications of our 
conjecture in other systems are currently underway. 



Summary. — In this paper we have introduced the 
notion of information compressibility Ki (Eq. 7), which 
describes the ability of an open system to change its en- 
tropy in response to a variation of its energy. It is a natu- 
ral extension of the equilibrium thermodynamics quantity 
(3 = 1/kgT to which it reduces in canonical equilibrium. 
This concept, however, extends also far from equilibrium, 
where the notion of temperature is less obvious. In fact, 
we have analytically shown that for a two-level system 
coupled to external baths, the information compressibil- 
ity is inversely proportional to the temperature a probe 
coupled to the system would measure when it minimally 
perturbs the system's dynamics. We could not however 
prove this result in the general case. We have also demon- 
strated that knowledge of Kj provides information on the 
dynamics of the system as it approaches a steady state, 
and validated our results with a simple example. The con- 
cepts and results described here are, in principle, testable 
within present experimental model systems [10], and we 
hope this work will motivate studies in this direction. 

Finally, we believe that the concept of information com- 
pressibility can be a valuable tool in studying the dynam- 
ics of out-of-equilibrium phenomena, and may be useful in 
characterizing, for instance, dynamical phase transitions 
such as the glass transition, where the properties of the 
system vary dramatically. 
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